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ABSTBACT 

Presented is a discassion of three types of teacher 
coepetencies: cognitive, perforeance, and conseqaencee The stud; 
identifies sose sethods for seasering ootcoies in each of the three 
categories. Also discussed is the problen of designing research 
studies for invest igating teacher effectiveness • (FBB) 
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HtMuring TMchat Co^pttne« 



JtMS R» Ok%7 and Dould W» Runphnyt 
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TMchar cosnatmea rtfars to tha eapabilitiaa and capacitiaa of 

taachara» or aa Roman and Bona ton (1972) atata» to thair **poaaaaalon 

of raquirad lcnoirladsa» aklllat and abiliciaa/* A variatj of paraona 

or groupa nay ba intareatad In naaauring taachar conpatenca— 

a. taachar aducatora nay vlah to datamlna if objactivea 
of couraaa or programa ara balng achiavad. 

b« taachar licanaing agandaa nay vlah to datanalna if 
cartificatlon atandarda hava baan nat by applicanta. 

c. taachera nay vlah to neaeure their own skills for 
purpoaea of aelf-lnprovenent. 

d. principals I aupervlaorsi or departnent chalmen nay 
vish to naaaure teaching skills as part of Inaervlce 
education efforts. 

e. researchers nay vish to neasure teaching skills In 
studies of teacher behavior. 

f . developers or evaltiators nay vish to neasure teacher 
conpetence vhen validating teacher education naterlals 
or procedures. 

Thus the range of reasons for neasurlng teacher conpetence are 
vide; neasurenents nay be nade of teacher behaviors to ansver either 
local evaluation questions or to establish broad research generalizations. 
Similarly I the range of persons and organizations Interested in teacher 
conpetence Is vlde~a sixth grade nathenatlcs teacher may wish to check 
on her ovn skills » a school board may want Information about the effective- 
ness of all reading teachers in a school systemi or a state certification 
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board may nMd data on tha capabilitiaa of Induatrlal arta teachara in 
a atata. Thla papar will daal with aona of tha problama to ba facad 
and procaduraa to uaa when any of thaaa indivlduala or groupa attempt to 
meaaura the competence of teachara. 

Typea of Teacher Competendea 

Houaton and Hovsam (1972) describe three typea of teacher compe- 
tendea or outcomea—Vhat teachers know (cognitive) » what teachers do 
(performance) t and the results they produce with pupils (consequence). 
Emphasis on the different coiiq[>etencles may vary from one program to an 
another. Historically » knowledge and performance have received the 
most attention but that situation Is changing. What pupils are able to 
do as a result of teacher Intervention Is a growing concern in teacher 
training. 

Some examples of cognitive » performance, and consequence teacher 
competencies are shown In Table 1. In some cases a particular com- 
petency may not classify cleanly Into one of the three categories but 
they seem sufficiently distinct to aid our thinking yAten planning, 
operating, researching, and evaluating teacher training programs. 

McNeil and Popham (1973) place special emphasis on the effective- 
ness of teachers (consequence outcomes) as a measure of their competence. 
Other outcomes are important too but they feel that assessment of teacher 
characteristics and performance has been overworked at the expense of 
measuring teacher accomplishment. An argument can be made, however, for 
concern by educators about each of the three types of teacher outcomes. 
For many skills the three outcomes may be logically related to one another-** 
certain knowledge (cognitive) is necessary for certain teacher classroom 
behavior (performance) which is, in turn, necessary for certain pupil 
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TABU I 

Bx^l«s of Thr«« Types of TMchar CoopetanclM 



lypa of 
Gonpetency 


Exanplea' 


cognitive 


a. :vrlua o^activaa that include conditions, 
behavioral terms, and levels of acceptable 
performance 

b. describes objectives, rationale, required 
classroom conditions, and materials for two . 
conMrcial curriculum programs 

c* Identifies the intellectual development 
stages of children and characteristics 
associated vlth each. 

i 


perfoxnance. 


a. develops and administers diagnostic tests 
to obtain data on pupil achievement of 
objectives 

b» selects classroom activities differentially 
for students based on their interests, 
. aptitudes, and. previous achievement . 

c* uses questions from each level of the cog- 
nitive taxonopy during classroom discussions 


• consequence . 

< 


a* presents evidence of attitude gain for at 
least half the students on^-two units 

b« obtains 80% achievement or better from all 
students on a standardized teacheri perfor- 
mance test 

e« presents evidence to show at least one year 
gain for 80% of students on arithmetic skills 
subtest, of ITBS* 
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achlevement (consaqutnca) • In labia 2» two axanplaa ara givan that 
ahov logically ralatad tognitive par£ormanca> and conaaquanca outcomaa. 
Training and avaluation would focua on tha cognitiya outcona firat, naxt 
tha parformanca laval and than nova to tha conaaquanca leval bacaupa 
of a preaunad (and taatabla) hierarchical ralationahip batwaan achiava- 
nent by teachara at each of the levela. 

TABLE 2 

Logically Related Teaching Jahavlora 



Type of 

Competency Slclll Area 



consequence 



t 



performance 



t 



cognitive 



Question 
Asking 

Demonstrate that X% of 
pupils answer X% of ques- 
tions on a test following 
a classroom discussion. 



Ask at least X questions 
from each level of Bloom's 
Taxonomy during a class- 
room discussion. 

Write and identify ques- 
tions for each level of 
Bloom's Taxonomy. 



Diagnostic 
Evaluation 

Identify the specific 
learning difficulties of 
pupils on the objectives 
for a unit from results 
of a diagnostic test. 

Prepare and administer 
diagnostic tests to pupils 
on the objectives for a 
lesson. 

Describe characteristics 
of a formative or diagnos- 
tic test. 



Sources of Teacher Competencies 

A nuxnber of teacher education programs have specified the behaviors 
or competencies they expect trainees to acquire. The model elementary 
teacher training programs financed by the federal government are examples 
of this. Catalogs of competencies have also been compiled from which 
teacher educators may select outcomes for a local program (e.g., Dodlf 
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•t, al«; 1971 or Turner t 1973) • Usually these colleotione. qf teacher 
eductttibn oblectlvee or eoBpeteneliee are broad atatewen^a <o«8*» the 
teacher ' provldea bppovtuaitiiia tot atudeata to uae the prpceaa skills 
of sdOQce) that require the uaer to define drcumstancef under Vhlch 
the ekiUs will be esdiibited and specific behaviors that define a9hleve^ 
nent of the coopotency* 

Heasuring cognitive outcomes 

Most cognitive outcoMS of teacher training , can be assessed with 
paper and pencil testa and without access to pupils or classrwoms. Such 
tasks as writing performance objectives , describing Intellectual develops 
ment stages » identifying sources of teaching materials , or describing 
procedures for pupil motivation are included^ here. 

Cognitive outcomes include some of the planning skills of teachers 
(such as writing objectives or idjentifylng teaching, mterials) and know^ 
ledge about classroom procedures (such as describing alternative methods 
for motivating students or identifying uses of formative and summative 
tests). In spme cases cognitive teaching skills may be taught and assessed 
by using audio or video tapes of actual classrooms. For example , audio 
recordii^s pf classroom discussions. may be naed to teach and assess the 
skill of identlfyltig different types of teacher questions. A video tape 
of a classroom may be used to teach and assess the ability 1:0 identify 
reinforcing words and actions of a teacher. 

Measuring performance outcomes 

Performance outcomes are the doli^ skillis of teaching. Many » but 
not ally require a classroom setting while they are learned and assessed. 
For BXBxaple^ performance competenclea such as using a variety of questions » 
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administering teata of Intellectual atages to children » tutoring atudenta 
and conducting dlacuaalona are all Interactive teaching akllla. If they 
are not learned and aaaeseed In regular claasrooma a aubatltute such aa 
peer teaching among teacher candidates la needed. 

Another category of performance outcomea may be learned apart from 
classrooms. Preparation of teaching units » operation of audio visual 
equipment and Identification of learning difficulties from pupil diag- 
nostic tests are all tasks that a teacher performs dither before or after 
pupils study. Although these skills may be learned and assessed apart 
from an actual classroom their relevance may be related to the context 
in which they are learned. Thus It may be helpful (but not necessary) 
to learn these In a field setting to heighten their significance to . 
teacher trainees. 

Observation Instmments developed for coding teacher-pupU verbal 
Interactions such as Flanders Interaction analysis (1970) are Important 
tools for measuring teacher performance. Desired performance levels or 
patterns of outcomes on the observation Instruments can be established 
and used to assess teacher behaviors. Preparation of video or audio 
tape recordings of lessons may be used to capture the performance of a 
teacher for later performance assessment. 

Worthen (1968) and Clesla (1973) report on Instruments used to 
measure the use of a particular teaching strategy in a classroom. Both 
verbal (e.g. » the kinds of responses to pupil questions) and non-verbal 
(e.g., frequency of diagnostic tests) aspects of teaching are included in 
the V7orthen and Clesla instruments. Both of the instruments wer^ used 
in research studies of teacher behavior but would be suitable for moni- 
toring the performance of teachers and providing feedback while they 
attempt to learn a teaching strategy. 
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...^f^ general strateffir for neaaurlng performance competencies of 
teachera is to develop or locate observation Instruqents or rating 
ec^lea that Includes items , on fill of the aspects of, the teaching perfor- 
mance that are important. The teaching performance itself (e.g.» a 
classroom lecture) or the ^product, of the perfonoance (e.g.* a set, of 
individualised instruction plans) is then assessed with the chosen 
Instriunent. 

Measuring consequence outcomes ' 

Teaching is carried out so pupil biehaviors will be changed. To 
measure consequence outcomes is to determine how teacher ' actions have 
affected pup-M behaviors. Thus, measures of cognitive achievement » 
affective or attitude scores » and psychomotor skills of pupils are all 
potential consequence measures of teacher competence. 

Consequence measures can be as diverse as the diijectives teachers 
attempt to accomplish. If a teacher is attempting to' get students to 
successfully add and subtract iEractlons then a posttest on the skills 
will indicate the degree to which bbtti the pupils and the teacher hc^ 
been successful. Similarly » if a teacher has set the objective of / 
increasing voltmtary use of the library then discreet checks on the level 
of pupil library use will be the means of measuring the degree to which 
the teacher has caused this behavior to occur, 

Popham (1973) has developed teaching performance teists to u^e as 
consequence measures. Teachers (of teacher trainees) are given a brief 
written introduction to a topic and one or more pierfbrmance objectives 
to accomplish with a class. Then at' some' later ibime (say » the next 
day) the teachers conduct a brief class to attempt to get students to 
accomplish the objectives. After the class a test on the objectives 
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(that has not been seen by the teach6r)* la administered to the students. 
The students also .complete a brief attitude measure to. indicate how they 
liked the lesson. Together, the teat on the objectives and the attitude 
measure can be used to Judge the ability of teachers to achieve certain 
ends. 

Consequence outcomes can be measured with standardized teacher 
performance tests like those developed by Popham or. by using whatever 
objectives 9 materials , and pupils are available in a local setting. 
There are advantages and disadvantages, to either practice. In either 
case, the major concern with mieasuring consequence outcomes .is the degree 
to which teachers can be held accounitable for and evalua^ted by, the . 
performance of their students.. Little Is know about how, to adjust ( . 
expectations of teacher success when they worK with pupils that haye 
different entering abilities, backgrounds, aptitudes, motivation, and 
learning rates. Differences in subject matter difficulty, instructional 
materials, and c!^>assroom settings may also have important effects oi:t 
pupil achievement and, therefore, teacher consequence measures. 

Efforts to measure teachers in terms of what they can accomplish 
with pupils seem to be correctly directed. Teachers should bo evaluated 
by what their pupils can do. At the same time, however, using pupil 
outcomes as the only criterion of teacher competence seems foolish. 
Until greater knowledge of cause and effect relationships between teacher 
and pupil behavior Is available we should be cautious about demanding 
ends from teachers when we can not provide them with the means of 
accomplishing th^m. 
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Deelgne for tneafturlng teacher ccwnpetence 

Suppose ttUit-a univeirslty requires teacher candidates to present 
evidence of their effectiveness before they will be recoimoended for 
licensing. Or » suppose that a researcher seeks data to show a cause and 
effect relationship between teacher questioning skills and pupil 
achievement. Whr^t kind of data will be acceptable In each case? 
Questions about acceptable evidence arise in every effort to measure 
the competence of teachers. 

To get at the question of acceptable evidence , it is useful to 
distinguish procedures for answering questions of local concern from 
those for establishing broad generalizations. The distinction is Im-* 
portant because teachers and persons concerned with conducting teacher 
education programs often need answers to questions of only local Interest. 
On the other hand» researchers» developers and evaluators are often 
concerned with answering questions of interest to a wide aud±ence^ 
The procedures used to obtain acceptable evidence in one situation may 
be different from those in the other. 

Campbell and Stanley (1963) describe a number of designs fot con- 
ducting research and evaluation. Among their designs are those for 
conducting true experiments (Posttest-Only Control Group Design^ Pretest* 
Posttest Control Group Design^ and the Solomon Four- Group Design). The 
true experimental designs each contain one or more control groups that 
assist in obtaining valid conclusions. For any attempt to establish 
generalizations about teaching and learning use of these true experi?? 
mental designs is desirable. To do otherwise allows for alternative 
explanations of findings. 
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Consider th« case mentioned previously in Which a researcher wishes 
to show a direct relationship between teacher questioning skills and pupil 
achievement. Teachers can be selected and randomly assigned to two 
groups. The questioning skills of teachers in both groups and the achieve- 
ments of pupils in their classes are measured for a short \init. Teachers 
in one of the groups then study special materials and learn to use certain 
question asking skills. Following this, both groups of teachers teach 
an additional unit. Teacher questioning skills and pupil accomplishment 
are again measured. If the results show that tcmchera and student 
behaviors for the two groups were similar. before acquiring the new.ques-* 
tionlng skills and different after doing so, strong statements can be 
made about the relationship between teacher questioning skills and pupil 
achievement. 

Now consider a case In which decisions on teaching effectiveness 
are to be made about the teachers in a field--based program for pre 
spective mathematics teachers. As part of a student teaching f^slgn** 
ment each prospective teacher must teach a two week unit in which at 
least 80% of the pupils acconiplish 80% of the objectives.. The regular 
classroom teachers have responsibility for monitoring the collection of 
final test results and altering the standards in unusual circumstances 
(e.g., for high ability students). Is it essential in this situation 
that true experimental designs with pretests and control groups be used 
to show that the task has been accomplished? Of course not. The 
design referred to by Campbell and Stanley (1963) as a One Shot Case 
Study would be quite acceptable. Objectives and testing procedures 
are set, the teacher teaches, and pupils are examined. If th3 objectives 
and testing procedures are judged acceptable by the regular classroom 
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teacher and the 80-80 drlterlon is Mt all le well. No fancier procedures 
are needed to anewieir the question of whether the prospective teacher 
meets the criterion of demonstrated effectiveness. 

To summarize the argument » experimental designs ate Is^ortant for 
researchers 9 developers » and evaluators that wish to answer questions 
that apply to an audience beyond the one being studied. If teachers, 
principals, supervisors, and operators of teacher education programs 
wish to answer questions that apply only to their own situations , con- 
siderably less rigor is needed in the designs used to collect the data. 
Campbell and Stanley* s (1963) One Shot Case Study and One Group Pretest- 
Fosttest Design Lte quite adequate for local evaluation efforts. 

An intermediate type of design that has some application ate quasi- 
experimental designs (Campbell and Stanley, 1963). These allow for more 
control than the one group evaluation designs just described but are less 
difficult to arrange than true experimental designs when conducting 
field research. An important feature of some of the quasi-experlmental 
designs is that teachers can serve as their own comparison or reference 
points in a study. Examples of how quasi-experimental designs can be 
used to measure teacher competence are given In Okey and Ciesla (1973). 
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